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l^ike many of^the papers presented at the Literacy Conference, Professor. Cal fee J s 
paper is sane, balanced, and thoughtful. Although I would not have written the same 
paper, there is little in the paper with wluch I directly disagree • 'What I am going 
CD to do here, therefore, is to firs»t briefly mention two o£ Professor Calfee's pqints 

vxJ , ' * . ^ ^ : . 

that I would particularly emphasize and. -one of his points that I have some qualms 
. about and then use several of hi^ points to* advanfce two of my own* perspectives on literacy J 

The first point I waiit ^to emphasize concerns reliability. All I can do here is 
echo Prbfessor'Calfee. Most current tests do not yield reliable profiles of subskills, 
and current practices used to achieve reliable total test scorejs mitigate against creating 
reliable subtests. We obviously need reliable subtests if we are to plan instructjLon 
appropriately. -* . . • " 

The second point I would emphasize concerns the theory behind the test suggested-' 
In taking as his starting poiiit the assump^"ion of independent processing — "that the mind,, 
carries out certain activities through the operation on independent cognitive processes^' 



— and (^^eloping from that assumption an' infomation processing, model that emphasizes 
attetjtion, decoding^ -and word understanding ^skills as separable processes involved in 
a "student's ability to 'read' and understand single vords,'^ Professor Calfee is very 



* definitely beginning from a theoretical perspective that can have practical instructional 
implications. * A logical instructional procedure *to use with a child who understands a 
large number of words but can read only those he has ^een explicitly taughttis to 
>^ teach decoding skills. And the theory behind Professor Calfee's test leads directly„ 

% ■ ■ - • . • •• * • 

:'\Si to •focused '^nstrutt ion such as this. • * • / - 

^ The notion of focused instruction for each child leads to a third point Professor 

Calfee considfers. .This is the one I have some qualms about. The qualms have to do with 
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the -practical feasibility of individualization. In talking about what a teacher needs 

to JcROw, Professor Calfee stated that a test should reveal a ''student ' s ^unique pattern 

of strengths and weaknessess, " My question^is. that of how much detail that the^teachef 

needs and. can te reasonably expected to use.. ^- T repeatedly hear the assertion that 

. individualization is one of the most important ^oals that teachers should work toward 

In a paper presented earlier at thi-S conference, "Pr^ofessor Popp notes that her own - 

' ^ * ' 

research has indicated the value of diagnostic prescriptive practices followed by 

individualized instruction and cites results obtained by^Samu^s and Edwall (1967) as 

also supporting individualized instruction. However, the findings of Samuels and 

Edwall ajso ^upp'ort the value of structure, and the major review of research "receatl^y 

• completed by RosensI||he (1977) again indicates val,ue of structure.^ In keeping with 
* ' . , Jf- 

the latter findings, my own^work in^ tutoring (Graves, 1976, Graves and Patberg, 1976) 

and the work of Ellson (Ellson, •1976> Ells(*h, Harris, and Barber, 1968) Roseniaurn 

(1973), and Vori' Harrison .(1972) indicates the v#lue of highly structured programs that 

penilit individualization a^ost solely in terms of "rate, 

.In light of these findings regarding the value of structure, 1 very seriously 

concjemed about how much structure*, sequence^and prder the teacher can provide while-' 

•creating individualized programs. In fact, while if is undeniably true th^t there are 

> • • 

•a number of classrooms in which instruction is, not geared to the varying needs of the 
^ Students, ones in which individual i station is vitally needed, there "are a number of 
other 'Classrooms * ini which the attempt of individaulization results in chaos, in each 
student doing something different but tfith few if any of them follorwing a structure * * 

* sequence that makes much sense. < . - ^ . 

I turn now to**a consideration of several of Pgrofessor Calfee^s points from, which* 
I will attempt to. draw two. of my perspectives Ton literacy. In his comments on theories,* 
Pr(!)fessor Calfeef both recognizes the very limited effect that theories of reading have 

• had in solving ..practical problems and hol'ds out for the potential value of theory - - 

' •* » 

" "Xothlhrig," he echoes a host of theoriticians, ';.is so practical as a 5ood theory.'-* And, 
" ' . ' ' . ' - . ' • L- 

ERIC ^ .3 • . . .. 



he continues, "an adequate theory of reading should point us to appropriate methods 
of test design and construction, and. should direct us to proper techniques' of analysis' 
and interpretation of -the results." In Ae paper preyiousjy mentioned, Prtifessor Popp' 
also argues for the practical value of theories!, noting that at lekst some theories 
have very definite instructional implications; As part of her argument, she shows 
how different theories lead to diffierent instiiictional pro-ams -- programs "beginning . *: 
with sound-symbol correspondences (Lippinc6t.t:XV. . aiid moving up to syllables and 
words, .phrases and short sentences," or pfograms, "beginning with sentences, working - 
do\m to words and finally to letter correspondences {Scott Foresraan)." This is ."certainly 
true. Different theories do sugg^s.t different instructional'" practices . The problem 
is that there are a plethora of theciries*, many of which point in different directions 
As Professor Calf ee gut in a previous paper, '»The txoojis seem in con^derable" disarray. 
-(1976, p. 44) " , ' ^ ^ ^ ^ * * ^ 
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, ...is disarray, I believe, must be recognized and acknowledg^'ed in lay seriou^ con- 

^ideration of the effect of theory on pract>ice. The knowledge necessary to, make informed 

decisions a:bout competing* theories, and hence, informed decisions'* about , competing tests 

and competing instructional practice, is needed by test developers, by those.'of us who 

^itrain teachers, by teachers, and by tKose school officials who purchase ' t(Ssts. Such" 
! . ^ . /• ^ ; / . . • . 

theoretical knowledge is ifot currently shared by members of. these various groups. In* - 

fact, information about the theory behind specific testing procedures is rarely included . ' 

in-Xest manuals. Moreover, at the present time, including such information in te^ / 

manuals would probably be of little use. According* to Bu3crows-.Cl'9^)*, «ie^ vast majority 

Of test sales are the result of marketing practices rather* than of. the quality of the ^ " ^ 

tests. This^ is not surprising when^-most test users latyk the background knowledge to 

re'asonably assess tests. ^, . ^ » ' t*^ , ^ T'-'- 

-- ** * \ * * ' 

Another point Professor Calfee makes is ^at concern and confusion about testing h--* 

is rampant. Thfe confusion exists ^cause of the^'cited' inadequacies of , the tests for - — 

the purposes for which they are often useli, and it exist's because of the lack of , j 



' understanding about tests (more specifically about nonus] by both school people and 

'the public. Professor Calfee explains^the inadequacies of^'the tests /quite clearly, 

' ^ ^ \ * \ ' 

but I think more needs to be said about the lack df knowledge abqiit tests and tasting. 

By way of illustraftion, T[ ivill cite some experiential evidence. At a ^recent yiational 

^ > a, ( 

confe^encq. attended b'y Ph.D. candidates in the language arts, some 20 percent of .those 
present failed to correctly, answer a multiple choice item which essentially asked, 
"IVhat does a percentile rank indicate?*' (Graves and Koziol, 1974) More inunediately; 
in surveys of several inservice reading courses I teach, ^nly 40 percent of the teachers 
* correctly answered th^ same question. If the majority of teachers -and a sizeable 
percentage of Ph.D. candidates do not understand even the simplest statistic^ used to 
report test results, then much of the general public is almost certainly confused 

r « • 

by reported 1>est statistics. - ' , 

The result of this confusion is concern, and this concern has different corfse- 

quences for the general^ public and for teachers. * On the one Hand^ large nu/nbers of the 

general public ber^-te the' schools for their, generall iiieffectivehess, and half the parents 

' \ / ■ ^ 

in the country worry, because "their children scoye below grade level. The support for 

scjopoling wanes. At a time when the decline of the school age population,' the decline 

, of federal st^pport, and rising costs jn^ke the schools increasingly dependent on local 

support, voters are becoming^ iijcreasingly unwilling to pay for schooling., Paren,t3 

demand '^return to thfe basics" and schools respond by dropping innovative programs ^ 

I 

and replacing them with traditional programs. * " . ■ 

On* the otherhand, a very common consequence of teachers becoming confused* about 

. testing is for * teachers tfo become extremely wary of tests arid tesb results. One xe- 

spdnse to sucfi wariness is to ignore test results. In one district iiri which I taughlvv 
^ ' • * 

« class attended- by teachers who had volunteered to ,lead a dist?rict-wide reading < 
effort, not one of.'the teachers in the class knew where the standardized teat results 
were. .. In another district, the standardized test ' results, of all of ^the students in [ 

' ' * ^ - . . ,t : 

t<v,o schools were lost. A more extreme response to the fear of testing is to \see 'testing 



. . ; , > - ■ ■ • ^ _ \ . • : 

as constituting a serious threat to studeitts.* Teachers in a nearby school are not- 

' pejmitted to see the standardized test* results because the teachers^ themselves voted 

against being allowed* to see them. In still another case, a teacher in a compensatory 

edu*c»ation program I administer quit rather than, give students ^ te.rr minute test on 

« 

th!^ vocabulary he' had been teaching for six weeks. • * , 

\ ] ' ' ^ ' . ^ * 

What I want' to* suggest, frofli both consideration of the* need to deal with theory 

' in order to make intfelligent decisions about tests^ and consideration oi the confusion 
and concemthat tests frequently cause, is that many of those involved'in the teaching^ 
^ of reading need to be better educated than they 'currently, are. In particular, I'm 
thinking of the. classroom reading teacher". ' . » • 

Let. me hasten to add here that .1 ^ ncft placing the -blame for this lack of 
education .on teachers^. As Professor Bormouth pointed out in the 'jfapei* which opened*, 
this "conference, ths infonj%t4on exchanged in a learning situation defends ^oth on ' 
the receiver and the message. And teachers in this country have been getting aci 
•extremely thin message. An analogy based cfn personal e^erience may serve to iyustrate 
thi^s point. Some years ago,, the army seht me to' typing school. , That school lasted four 
hburs 'a day, five d^ys a week* for four weeks a total of 80 tJburs- During that 80 
hours, J did leatn to ty^^, but'I dld'.not learn to type verywell, and I still have to 
look at the keyboard to find the keys for quotation marks and other symbols,- By-con^ • 

* tras^t, today, in 70 percent of "the teacher-training institutions in this .country, students^ 
preparing to be "elementary reading teachers receive 30 or fewer hours of classroom 
instruction in teaching reading, ^ (Morrison and Austin, 1^77) I thirtfe thsit is absurb and 

an outi;a^e. - . . ; ) 

f * ' ^ |. . " • \ . ' 

, \ My fi^i^st perspective on literacy^ therefore, is^that we heed* to provide a much ' 

j • '[ * ^ ; — \ • ' ^ • ^* ^ ^ ^ . / 

j^ter education for readi^ng teacHers than we are currently providing 



\ better ^education for readi^ng teachers than we are currently providing and that in 

' .ordefr to proiXide such -an education we are^goiag, to KaA/^e to devote radically larger 

• * * * * • ' ' • 

amounts of time to that task* th^n we"" currently give it. A 

\ - / My. second {perspective on literacy i*s closely relate^ to the-first. It ^t^ms 

O , ' . »^ / ' . ^ ^ 

gPJ(^)rn points professor Calfee makes about the tfcst for reading single worSs and about 



the Interactive Reading Assessment System 'CIRAS), . # • . . ' 

I will take as a^glven the model oT attention, ,d.ecodaTi|^ and le^i-cal 'inter- 

I ' , * ^ : ^ • • V. . ' , . ■ . 

pretation that underlies the test. But then I have a questioji, JVhy, of the myriad 
of factors that might be considered to effect attention,^ is the specific- factor^of 
a . quiet room -versus a noisy room tested? Other, j^ari'ables\ome' immediately to mind: ; 
r time of day V first thing %n the morning versus ninth peri'od:* span 'of attention / 
^ the first five minutes versus the last five minutes in thirty minutes of readings or ^ 
^.topic /current movies versus nineteenth 'century housing costs. Certainly, reaction 
to *both room noise and tiine of day provide us with soi^^ information abbat a^ studeitf's 
pattern of attention. But equally certain is the fact that some Jcids would l>e greatly ' 
bothered by room noise and unaffected by time of day while others woiilf res^n^d in an 
opposite fashion. /"And, of course the reaction to the other indicies of attention 
suggested ^ill also vary different jally with students. ^ * * ^ \ ' 

Similar questions could be rais'^ed aboilt the variable affecting word understanding.^ * 

. • ft , ' 

Familiarity as indicated by frequency is one possibility: . But again *other variables' 

sach as Jength and level of abstracting , come to mind.^' * . 

Turning to the IRAS, I have somewhat^ different questions. I wonder^ for example, 

abpu^: the practice of testing only silent reading. - I wOndei^ about the reliability of ' ^ 

the profiles of question types when relatively few iiuestion^ oi each type ckn- be* found. 

I also wonder about the^ feasibility of aski-ng kids to pick apprgp^ate paragraphs. A 

myriad of other questions come tb mind, but here I wijl only note two more. Wh,en I 

read that one feature of the IRAS will aliow teachers to assess the effects- of giving.^ 

students prompts. I am curious about many asgects. of performance a teist can reasonably 

assess. And when I learn that recognition versus production is to be tested, I am-turious 

.about ho^^A teachers will be^able to use^thfe results. . ^ '* ' • 

^ Considering ^this rather long list of questions, I would^ote that' the ansx^ers must 

cone from varied sources. Wleory, for example, provides some information." jTheory, 



• \ .■■ . 

* f or example, tells, us something abo'at'JHe relatipnship between oral aqd silent readincr, 

^ »• . "» » ^ 

, ' ' ' . ■ *' . • * ' 

- And^the question of Kow able students .are to'pick appropriate paragraphs can -be answered 

empirically. But som^ of the othfei: questions/ such as those about useful indicies of 
attention or the number of'apsects of perforr.ance 'tnat can reasonably be tested, as. best 
answered by practicing :classroom teachers, '\ \ . ' . 

This leads directly to the second perspective on literacy. I, v^'ou Id offer. Those 



of us in university teaching and research positions must do more than provide a better 

< * ♦ . • 4 

education for reading teache,rs, 'we must also receive' a better education from readino- . 
teachers. Real improvement in students reading ability is only likely to come when the* 
various persons that effect the reading prograa students receive'-- test' developers, 
program developers, university professors, and public school teachers and administrators- 
work together to. improve the assessment and the consequent irvstructioh tfrat students 
receive. . . / *. . 
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